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PATENT 



REMARKS 

Claims 10, 12-13, and 16-21 have been examined, claims 10, 12-13, 16, 18-19, and 
21 are amended herein and claim 22 is added. Accordingly, claims 10, 12-13, and 16-22 are now 
pending in the application. Reexamination and reconsideration of all outstanding rejections and 
objections is requested. 

Claims 10, 12, 13, and 16-21 are rejected under 35 U.S.C. §102(e) as being 
anticipated by Hoffert et al. (US 20010014891 Al) 

Amended claim 10 recites software that when executed is operable to display a 
plurality of image maps within a Web page on a client computer coupled to a network environment. 
The image maps are representations of a multi-dimensional image having more than two- 
dimensions. Locations in the two-dimensional image maps are specified by values of first and 
second coordinates which specify locations in the representations of the original multi-dimensional 
image. 

The software when executed is operable to select a particular location on one of said 
two-dimensional image maps having particular first and second coordinates, where selecting the 
particular location on the two-dimensional image map determines a multi-dimensional coordinate, 
including at least three coordinate values, which indicates a specific location in the original multi- 
dimensional image. 

The software when executed is operable to access a correlated location in a secondary 
map homologous to said specific location to retrieve a specific object index for said specific location 
after said particular location of the two-dimensional image displayed on the client computer is 
selected. The secondary map is a data structure which holds a plurality of multi-bit object indices at 
locations in the secondary map. 

In a preferred embodiment, the software when executed is operable to cause a server 
computer coupled to the network environment to utilize the specific object index for said specific 
location to access a program action associated with the specific location. 

The Hoffert reference teaches that the Web is crawled and a database of video files is 
created including media URLs and relevant lexical information (text) is stored for each URL. [0050] 
Other information is also stored with the media URL, such as the name of the media file, keywords, 
auxiliary data, etc. [0069]-[0080]. Additionally, videos are analyzed for content including motion, 
brightness, contrast, and color estimates. [0115]-[0116]. 
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A preview of a media object having predetermined characteristics is generated and 
stored and, in response to a search, the preview may be displayed. [0357]-[0358] The images may 
be panoramic [0380] or 3-dimensional [0389]. 

When search results are returned from a user's database, appropriate commands are 
generated to drive a web browser interface to facilitate interactive viewing of the search results. 
[0392]. The server application returns a series of HTML and EMBED tags which set up a viewer 
appropriate for the type of video to be viewed. [0393]. For example, if the user clicks down in a 
frame X of a filmstrip then an in-line viewer is created which will display and play back the movie, 
beginning at frame X [0394]; if the user clicks down at selected panoramic viewing parameters then 
an in-line viewer is created which will begin display of the panorama at those precise viewing 
parameters [0395]; and, if the user clicks down with a select viewpoint of a 3D scene within a 
filmstrip then an in-line viewer is created which will begin display of the 3D scene at the viewpoint 
[0396]. 

The examiner states that: 

Paragraph 7. Hoffert teaches that a user clicks down in frame X of a filmstrip 
(paragraph block 0394) which meets the limitation of select a particular location on a two- 
dimensional secondary spatial image having particular values of the first and second 
coordinates, where selecting the particular location on the two-dimensional spatial image 
determines a multi-dimensional coordinate including at least a third coordinate value which, 
together with the first and second coordinates, indicates an indicated location in the original 
multi-dimensional image; 

Paragraph 8. Hoffert teaches that a user clicks down in frame X of a filmstrip 
(paragraph block 0394) which meets the limitation of initiate access to a location in a secondary 
image map homologous to the indicated location to retrieve a retrieved object index for the 
indicated location after the location of the two-dimensional secondary spatial image displayed 
on the client computer is selected; and 

Paragraph 9. Hoffert teaches that a user clicks down in frame X of a filmstrip 
(paragraph block 0394) which meets the limitation of cause a server computer coupled to the 
network environment to utilize the retrieved object index for the indicated location to access a 
program action associated with the indicated location. 

This rejection is respectfully traversed for the following reasons. 

With regard to Paragraph 7 of the rejection: 
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The examiner asserts that when a video frame in the preview of Hoffert is selected the 
user necessarily clicks on some frame of the video clip thereby determining first and second 
coordinate values. However, in Hoffert the coordinate values of the actual location of the click 
within the frame are not used in any way. The only information used is the identity of the particular 
frame selected, which determines a single dimension, time, in the video file. This time value is then 
used to start showing the video at the selected time. 

There is no disclosure relating to the claimed limitation that selecting the location-of- 
interest determines a multi-dimensional coordinate value of the location-of-interest in the original 
multi-dimensional image. 

For example, if the multi-dimensional image is a video clip of the rotating earth then 
in the claimed system clicking on Germany would determine first and second coordinate values 
indicating the location of Germany on the two-dimensional view of the earth displayed at time tl. 
The multi-dimensional coordinate value would then include the first and second coordinate values 
(x,y) indicating the location of Germany and the third coordinate value tl, i.e., the multi-dimensional 
coordinate value is (x,y,tl). 

In contrast, in the Hoffert system if the user clicked down on Germany in a frame 
displayed in a preview, only the time value of the frame would be used to start running the video 
from the frame selected. The actual location of the click within the frame is of no relevance to the 
Hoffert system and a multi-dimensional coordinate is not determined. 

With regard to Paragraph 8 of the rejection: 

As described above, in Hoffert a database is built where information about a multi- 
media file is stored along with the URL of the media file. Information is then retrieved using the 
URL of the file. A URL specifies the location of the media file on the Web, there is no information 
relating to multi-dimensional locations within the media file. Accordingly, there is no teaching in 
Hoffert of the claimed secondary map in the form of a data structure having locations homologous to 
locations in the original multi-dimensional image. 

With regard to Paragraph 9 of the rejection: 

The program actions in Hoffert of selecting an appropriate viewer are based on 
information stored with the URL of the media file. There is no teaching of querying a secondary 
map to retrieve an object index for the location-of-interest. 

For example, in the claimed system, if the user clicked down on Germany when the 
earth was rotating, then a multi-dimensional coordinate value (x,y, t), where (x,y) specify the 
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location of Germany in the frame, could be used to retrieve an object index to access a program 
action that selects a URL of a web page about Germany. 

If the user clicked down on France in the same frame then the (x,y) coordinates of 
France would be part of the multi-dimensional coordinate value that could be used to access a Web 
page about France. 

In contrast, in Hoffert the URL of the file would be utilized to access information 
required to select the proper viewer for viewing the media file as the rotating earth. Whether the 
user clicked down on Germany or France would make no difference, the only relevant information is 
the single time coordinate identifying the frame in which the user clicked down. 

For a claim to be anticipated, all limitations in the claim must be disclosed or 
inherent in a single reference. Accordingly, in view of the above, the recited limitations relating 
determining a multi-dimensional coordinate value and to querying the secondary map for a location 
that corresponds to the multi-dimensional coordinate are not disclosed or inherent in the Hoffert 
reference. 

Independent claims 16, 19, and 22 include similar limitations to those argued above 
and are allowable for the same reasons as claim 10. 

Dependant claims 12, 13, 17, 18, and 19 are allowable for the same reasons as the 
claims from which they depend. 

CONCLUSION 

In view of the foregoing, Applicants believe all claims now pending in this 
Application are in condition for allowance. The issuance of a formal Notice of Allowance at an 
early date is respectfully requested. 
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If the Examiner believes a telephone conference would expedite prosecution of this 
application, please telephone the undersigned at (925) 944-3320. 

Respectfully submitted, 



/Charles E. Krueger/ 
Charles E. Krueger 
Reg. No. 30,077 

LAW OFFICE OF CHARLES E. KRUEGER 

P.O.Box 5607 

Walnut Creek, CA 94596 

Tel: (925) 944-3320 / Fax: (925) 944-3363 



